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is  proved.  A  characterization  by  variational  inequality  is  given,  leading  to 
local  and  boundary  behaviour  of  the  solution.  This  characterization  is  of 
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SIGNIFICANCE  AND  EXPLANATION 


The  problem  of  constructing  a  smooth  positive  surface  over  a  given 
domain,  matching  a  set  of  data  in  aggregated  form,  as  volumes  over  sub- 
domains,  is  important  in  the  estimation  of  densities.  For  example,  given  the 
population  census  according  to  political  subdivisions  (e.g*  counties),  it  is 
desired  to  obtain  a  smooth  positive  function  estimating  the  population  density 
as  a  function  of  the  geographical  coordinates. 

In  order  to  select,  from  the  infinitely  many  positive  surfaces  matching 
the  data,  a  particular  one  which  is  smooth,  we  require  the  surface  to  minimize 
a  Dirichlet-type  integral,  measuring  the  roughness  of  the  surface  over  the 
domain.  In  this  work  we  analyze  the  properties  of  the  minimizing  surface  and 
characterize  it  by  variational  inequalities  and  also  by  its  local  differential 
behaviour  in  the  domain  and  on  its  boundary. 

This  characterization  is  important  in  the  construction  of  numerical 
methods  for  the  production  of  discrete  approximations  to  the  minimizing 


surface  and  in  the  analysis  of  their  convergence. 
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ON  THE  SOLUTION  OF  A  CONSTRAINED  MINIMIZATION 
PROBLEM  IN  H*(Q)  RELATED  TO  DENSITY  ESTIMATION 

*  ** 

Nira  Dyn  and  Wing  Hung  Wong 


1.  Introduction 

In  this  paper  we  are  Interested  in  the  existence,  uniqueness  and  characterization  of 
the  solution  to  the  following  minimization  problems 


(la) 

subject  to 


minimize  J(u) 
ueH'  (Si) 


u*  ]dxdy 


(lb)  /n  uft  ■  a4  ,  1  •  1,...s  , 

( lc) 1 *  u  >  0  a.e.  in  SI  , 

2  2 

where  Si  is  a  smooth  region  in  R  ,  f  i  e  L  ( SI) ,  i  -  1,...,s,  and  H*(S1)  is  the  first 
order  Sobolev  space: 


1) 

In  case  SI  has  a  smooth  boundary,  the  non-negativity  almost  everywhere  in  (1c)  is 
equivalent  to  non-negativity  in  the  sense  of  H'(fl)  (u  >_  0  in  Si  in  the  sense  of  H1(ft), 
if  3 { }  c  c'(S))  2.  0  in  Si,  such  that  $n  -  $  in  H^ft))  (See  e.g.  Kinderlehrer  and 

Staapacchia  [6] ) . 
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are  the  first  order  distributional 


H'  ( ft)  »  {u  0  L2  ( ft)  su  ,  u  8  L2(ft) }  where  u„,  u 
x  y  y 

derivatives. 

This  problem  is  of  interest  in  the  production  of  smooth  contour  maps  from  aggregated 
data  (Dyn  and  Wahba  [3]),  and  in  particular  for  the  estimation  of  a  density  from  its  given 
volumes 


(1b)'  /flU”“i  '  1-1 . . 

i 

over  a  certain  partition  ft _,...,ft  of  the  domain  ft.  (Tobler  [7],  Wahba  [8].) 

I  9 

The  familiar  stationary  obstacle  problem  in  mechanics  (Glowinski  [5] )  is  similar  to 
(1)  without  the  linear  constraints  (1b). 

In  the  following,  we  limit  the  discussion  to  sets  of  constraints  (1b)  satisfied  by  at 
least  one  smooth  positive  function.  This  is  always  the  case  for  constraints  of  the  form 
(lb)*  with  ^  >  0,  1  -  1,...,s. 

In  section  2,  we  give  a  simple  existence  and  uniqueness  proof.  Using  results  from 
optimization  theory  in  Banach  spaces,  we  have  given  in  Section  3  a  characterization  of  the 
solution  in  terras  of  a  variational  inequality.  In  Section  4,  we  combine  the  results  of 
Section  2  and  Section  3  with  a  theorem  of  P.  8.  Brezis  [2]  to  study  local  properties  of  the 
solution.  In  particular  the  solution  is  found  to  be  continuous  and  therefore  non-negative 
everywhere  in  ft,  two  properties  which  are  essential  for  applications. 

These  characterizations  of  the  solution  to  ( 1 )  are  of  crucial  importance  in  the 
construction  of  numeical  procedures  for  the  computation  of  the  solution,  and  in 
establishing  their  convergence  rates  (Wong  [9)).  The  analogous  characterizations  of  the 
solution  to  the  obstacle  problem  (la)  +  (1c)  are  the  basis  to  several  numerical  procedures 
for  the  computation  of  this  solution  (see  Glowinski  [5)  for  a  review  of  these  methods). 

We  conclude  by  considering  in  Section  5  similar  minimization  problems  to  (1),  but  with 
the  functional  in  (la)  replaced  by 


,<u>  *  / c 


IQ 

l 

i-0 


(™) 


JB 

3  u 


Jx1  3yB 


Tr 
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•  vV>  y*,  •*  ■'fc-fcywj 
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Th«  results  obtained  are  analogous  to  those  for  the  case  m  •  1,  with  the  exception 
of  the  local  and  boundary  behaviour  deduced  fro*  Bresis'  result  for  m  ■  1. 

This  problem  with  a  >  2  is  of  interest  in  the  production  of  highly  saooth  surfaces 
fitting  given  aggregated  data. 


2.  Existence  and  uniqueness 


Theorem  1 :  There  exists  a  unique  solution  to  problem  (1)  whenever 


£-1  </a  v2  >  «• 

Proof i  Without  loss  of  generality  assume 
Then  ( 1 )  is  equivalent  to 


/jj  f^  ■  G  0,  and  let  u  -  u  -  j  a^. 


v  ^  2  v  2 
min  J(u)  “  f_  u  +  u 
'8  x  y 


subject  to  u  e  H*(Q)  -  {u  e  |  /^  uf1  -  0}  and 


k  fi  u  "  °i  -  r  where  Gi  “  fi'  1  ‘ 


u  >  -  —  a.e.  in  £1 


Now  functions  satisfying  (2b)  and  (2c)  are  easily  seen  to  form  a  closed  convex  set  in 

H'(fl).  It  is  also  easy  to  see  that  (J(u))%  is  a  norm  in  H* (fl).  This  norm  is  in  fact 

2  2  v 

equivalent  to  the  Sobolev  norm  in  H'  (£))  :  lu  I  «  J(u)  ♦  u  restricted  to  H'  (!)),  as 
can  be  deduced  from  Poincare's  inequality  (see  e.g.  Dyn  and  Wahba  [3]). 

Thus  (2)  is  the  problem  of  finding  the  minimum  norm  element  of  a  closed  convex  set  in 


a  Hilbert  space,  which  always  has  a  unique  solution. 


*  * 
sfc 


3.  variational  characterization 

For  finite  dimensional  optimization,  the  solution  Is  usually  characterized  by  the 
famous  Karush-Kuhn-Tucker  conditions.  There  are  extensions  of  the  Kuhn-Tucker  theorem  to 
Banach  space  setting.  We  will  use  the  following  extension  (Glrsanov  [4]  )s  If  Q  is  a 
closed  convex  set  in  a  Banach  space  H,  and  J,h^, . . . ,hg  are  Prechet  differentiable 
functions  on  H,  then  a  necessary  condition  for  u  to  minimize  J(u)  subject  to  u  e  Q, 
h^lu)  ■  c^,  i  «  1 ,  •  • « ,  s  is  that  there  exist  multipliers  A^,...,!  ,  such  that 

s 

(VJ(u)  +  y  X  Vh  (u) ) ( v-u)  >0,  V  v  B  Q  . 

1-1  1  1 

Furthermore,  if  J  is  convex,  h^,  i  -  1,.,,,s  are  linear  and  there  exists  u*  interior 
to  Q  satisfying  h^(u*)  -  a^,  i  -  1,...s,  then  the  above  condition  is  also  sufficient 
for  u  e  Q  satisfying  h^(u)  -  a.,  i  -  1,...,s  to  be  the  extremal  solution. 

To  apply  the  above  theorem  to  our  problem,  let  J(u)  -  a(u,u)  «  u  2  +  u  2 
h^lu)  -  f^u,  Q  ”  {ueH* (ft),  u  >  0  a.e.  in  ft},  and  H  »  H'(fl).  The  Frechet  derivatives 

are  given  by  (Vj(u))(v)  -  a(u,v)  =  J^u^  +  uyvy  *nlJ  (^(uJXv)  -  J^v,  i  -  1 . a. 

By  the  above  result,  we  obtain  the  following  characterization  of  the  solution  to  (1), 
for  any  set  of  constraints  (1b)  satisfied  by  at  least  one  smooth  positive  functions 

Theorem  2s  u  is  the  solution  to  ( 1 )  iff  there  exist  multipliers  A^,...,Aa  such  that 
a(u,v-u)  »  /  f(v-u)  for  all  v  >  0,  v  e  H '(ft) 

( 3a) 

s 

where  f  -  J  X.f. 
i-1 

(3b)  u  >  0  a.e.  in  ft  , 

(3c)  f  f  u  -  a.  ,  1  -  1,...,»  . 

i.  1  i 
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£ 

& 

&* 

V' 


By  the  same  arguments  we  also  obtain: 

Lemma  1:  Given  X^,...,!^  there  Is  a  unique  function  satisfying  (3a)  and  (3b).  This 

s 

function  minimizes  J(u)  -  f  (  J  X  f  )u  among  all  non-negative  functions  In  H'(ft). 

n  1-1  11 

4.  Local  behaviour  and  boundary  conditions 

If  In  (I),  we  Ignore  the  equality  and  inequality  constraints,  then  the  problem  becomes  - 
a  classical  calculus  of  variation  problem,  the  local  behaviour  of  the  solution  will  then  be 
given  by  the  Euler  equation  (vanishing  of  the  first  variation)  and  the  natural  boundary 
conditions.  In  our  problem  (1),  which  Is  constrained,  we  should  expect  to  get  a 
characterization  of  local  behaviour  similar  to  the  Euler  equation  In  the  unconstrained 
case.  We  will  show  that,  roughly  speaking,  when  the  constraints  are  not  active  in  a 
certain  neighbourhood,  then  the  solution  will  satisfy  a  differential  equation  locally  In 
the  neighbourhood.  This  kind  of  local  results  are  In  general  very  difficult  to  prove,  but 
our  task  is  simplified  considerably  by  some  existing  theorems  on  variational  Inequalities. 

2  —  2 

Lemma  2:  Given  f  e  L  (Si),  there  exists  a  u  e  H  ((1),  satisfying  the  following 
variational  Inequality: 

(4a)  /fl(- Au)(v-u)  >  J  f(\r-u)  for  all  v  >  0  a.e.  In  Cl,  v  e  H'  (SI)  , 

(4b)  u  >  0  in  !)  , 

du 

(4c)  In  “  0  on  ' 

where  Au  -  u  +  u  is  the  Laplacian  of  u  and  is  the  normal  derivative  at  the 

xx  yy  3n 

boundary  3(1. 


-5 


Proof :  This  is  a  special  case  of  theorem  1.12  in  Bresis  [2]  (page  55),  where  we  take 
8(r)  s  0  ,  -•  <  r  <  «,  in  applying  that  theorem. 

This  result  is  related  to  the  solution  of  (1)  in  the  following: 


Lemma  3:  Let  u  6  H  (12)  satisfy  (4).  Then  u  satisfies  also  (3a). 


—  2  i  \ 

Proof:  Since  u  c  H  (ft),  we  can  use  Green's  formula  to  write 


fa  "x(v*u)x  +  "y(v-u)y  -  fa  +  /an  £ 


The  second  integral  in  the  right  hand  side  vanishes,  because  the  function  u 
satisfies  the  boundary  conditions  (4c).  Therefore  by  (4a) 


a(u,v-u)  »  Jjj  (-Au)(v-u)  >  f(v-u)  for  all  v  >  0  a.e.  in  Si,  v  e  H' (£)) 
and  u  satisfies  (3a). 

Combining  the  results  of  Theorem  2  and  lemmas  1-3,  we  obtain  a  differential  type 
necessary  and  sufficient  condition  for  u  to  be  the  solution  of  (1). 


Theorem  3:  u  is  the  solution  to  (1)  iff  the  following  conditions  are  satisfied: 
(5a)  u  e  H2 ( £2) 


(5b)  There  exist  X X  such  that  u  satisfies 

1  9 


8 

f  (-Au)  (v-u)  >  J  (  y  X  f  )(v-u)  for  all  v  >  0  a.e.  in  Si,  v  e  H'(S1)  , 

si  SI  i  l 


1) 

See  Aubln  (1)  for  conditions  required  for  Green's  formula 


(5c) 


u  >  0  in  ft 


(5d)  —  -  Q  on  3ft 

an 

<5e)  /n  ,  i  -  1,...,s  . 

Proof :  The  sufficiency  follows  from  Lemma  3  and  Theorem  2*  To  prove  the  necessity  of 

these  conditions  assume  u  to  be  the  solution  of  (1).  Then  by  Theorem  2,  there  exist 

—  2 

such  that  u  satisfies  (3a) ,  and  by  Lemma  2,  there  exists  u  6  H  (£1) 
satisfying  (5b),  (Sc),  (5d),  with  as  in  (3a).  Hence  by  henna  3  u  satisfies 

(3a)  and  (3b),  which  in  view  of  Lemma  1  implies  that  u  coincides  with  u.  This  completes 
the  proof  of  the  theorem. 

Property  (5b)  of  the  eolation  of  (1)  is  equivalent  to  the  following  local  behaviour  in 
the  distributional  sense  (Brezis  [2]): 

s  s 

(5b)'  <-A u)  >  l  Xltl  in  ft,  (-4u)  -  l  I  f  in  {x  e  £hu(x)  >  0}  . 

i=1  i«1 

2  2 

Moreover  since  u  e  H  (ft),  Au  e  L  ( ft)  and  (5b)'  holds  almost  everywhere  in  ft.  Thus 
(5b)'  in  view  of  (5a)  is  equivalent  to: 

s  s 

(5b)*  -Au  -  J  A  f  >  0  a.e.  in  ft,  (-Au  -  £  A  f  )u  **  0  a.e.  in  ft  . 

1-1  i-1  1  1 


5.  Problems  of  higher  order 

Similar  analysis  as  done  for  problem  ( 1 )  can  be  carried  out  for  the  more  general 
problem  related  to  the  iterated  Laplace  operator: 


(6a) 


min  J  (u) 
m 

ueHra(0) 


m 

/ A 

i-0 


<r> 


r  3  u 

l.m-i 
3x  3  y 


>2 

) 


-7- 


subject  to 


(6b)  f  u  ^  «  a4  ,  1  - 

(6c)  a  >  0  in  0  , 

where  0  is  a  smooth  region  in  R^,  f^  e  L2(0),  i  «  1,...,s,  and  HI,(0)  is  the  m'th 
order  Sobolev  space 

k 

Hm(fl)  ■  {u|  — r~ -  8  1j  (0),  i  -  0,...,k,  k  »  0,...,m} 

3xA3y  1 

For  m  >  2  all  functions  in  Hm(fl)  are  continuous,  and  the  positivity  in  (6c)  is 
pointwise. 

For  this  problem  we  obtain  analogous  results  to  Theorem  1,2  for  the  case  m  =*  1 ,  for 
sets  of  linear  constraints  (6b)  satisfying  the  following  two  assumptions: 

(t)  There  exists  a  smooth  positive  function  satisfying  (6b). 

(ii)  There  does  not  exist  a  polynomial  q  of  total  degree  k,  k  <  ra,  satisfying 
/n  fjq  “  0.  1  ”  1, 

The  existence,  uniqueness  and  characterization  in  terms  of  a  variational  inequality 
are  derived  by  the  same  arguments  used  in  Sections  2,3.  We  formulate  the  results  and  omit 
the  proofs. 

Theorem  4:  There  exists  a  unique  solution  to  problem  (6).  u  is  the  solution  to  (6)  iff 
there  exist  multipliers  such  that 

s 

(7a)  a^u,  v~u*  *  I  for  a11  v  >  0,  v  8  H°<fl) 

1-1 

(7b)  u  >  0  in  0 


-8- 


(7c) 


h  fi  U 


1, 


fS  . 


tfhere 


(3) 


ja 
3  u 


.ra 
3  v 


VU'v)  -  /ft  l  (i>  a  1.  m-1  .  1.  m-i 

i-0  3x  3y  3x  3y 


In  order  to  conclude  local  and  boundary  behaviour  of  the  solution  to  (6),  an  extension 
of  Brezis1  result  (Lemma  2)  to  ra  >  2  is  needed.  At  this  stage  the  extension  of  Theorem  3 
to  m  >  2  is  yet  a  conjecture : 

Conjecture;  u  is  the  solution  to  (6)  iff  the  following  conditions  are  satisfied 


(9a) 


u  e  H2m(0) 


(9b)  There  exist  such  that  u  satisfies 

1  s 

s 

(-1)™  fa  dmu(  v>-u>  >  fa  (  l  A^f± )( v-u)  for  all  v  >  0,  v  e  Hm(fi)  , 
(9c)  u  >  0  in  0 


(9d)  6_  .  u  *  0  on  3(J  ,  I  * 

2m- i 

<9e)  ufi  “  “i  '  1  *  •••  's 


where  5  ,  i  =■  are  differential  operators  of  order  2m-i  defined  by  the 

2th— 1 

generalized  Green's  formula  (Aubin  U]): 


(10) 


a  (u.v)  -  (-1)"  {  (Amu)v  +  l  f  (6. 


i-0 


30  2m-l-i 


u) 


3n 


-9- 


The  local  behaviour  of  u  In  Si  Implied  by  (9a)  and  (9b)  let 


(11a) 


(11b) 


a 

( - 1  )BA™ u  >  5!  in  n 

1-1  1 


* 

t(-1)m&“u-  l  Xifil*u-  0  a.e.  In  0 


-10- 
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